"The highlighted tokens are primarily Japanese nouns, noun phrases, and compound words that denote concrete objects, locations, roles, or abstract concepts, as well as verbal nouns and set expressions. Many are used in formal, technical, or informational contexts, often marking key entities, actions, or conditions within sentences. There is a tendency to select tokens that encapsulate the main subject, object, or function in a clause, including terms for facilities, events, permissions, and quantifiable attributes."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.8 | 0.812 | 0.78 | 0.796 | 0.78 | 0.82 | 0.18 | 0.22 |
fuzz | 0.81 | 0.844 | 0.76 | 0.8 | 0.76 | 0.86 | 0.14 | 0.24 |